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Non-Final Rejection 
Response to Amendment 

1 . It is hereby acknowledged that the following papers have been received and 
placed on record in the file: Amendment as received on 5-14-2007. 

Claims 1-46 have been examined. 
Status of Claims: 

2. Claims 17-23, 25-29, 31-33, 35-37, 39, 40, and 42-46 rejected under 35 
U.S.C. 102(e) as being anticipated by Filo et al., patent #6,215,498, hereinafter Filo. 

3. Claims 24, 30, and 34 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Filo et al., patent #6,215,498, hereinafter Filo and Nitta, patent 
#5,347,306. 

4. Claims 38 and 41 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Filo et al., patent #6,215,498, hereinafter Filo and Sun et al., patent #6,501,740, 
hereinafter Sun. 

5. Claims 1-16 have been cancelled by the applicant. 

Claim Rejections - 35 USC §112 

The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

6. Claims 17, 20, 35, 39, 40, 43, and 45 are rejected under 35 U.S.C. 112, first 
paragraph, as failing to comply with the enablement requirement. The claim(s) contains 
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subject matter which was not described in the specification in such a way as to enable 
one skilled in the art to which it pertains, or with which it is most nearly connected, to 
make and/or use the invention. Specifically, support can't be found for "automatically 
changing, without any user input, the user's mode of communication". The page and 
line numbers pointed to by the applicant only provide for the user interface adjusting 
output response to output from the physical detector. 

Claim Rejections - 35 USC § 102 

7. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

8. Claims 17-23, 25-29, 31-33, 35-37, 39, 40, and 42-46 rejected under 35 
U.S.C. 102(e) as being anticipated by Filo et al., patent #6,215,498, hereinafter Filo. 

9. With regard to claims 17 and 20, which teach a system comprising: a mobile 
device for communication between a user of the mobile device and at least one other 
party, Filo teaches, in column 7, lines 9-15, and lines 25-36, a wearable personal 
computer that transmits changes in the users voice and positional data via a network to 
the personal computers of all other users in attendance of a virtual environment. With 
regard to claims 17 and 20, which further teach a mobile user interface for connection 
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with the mobile device including input means for providing the at least one other party 
with a representation of the user, Filo teaches, in column 3, lines 1-23, users being 
represented by avatars on the display device of users computers, the avatar's 
representation is based on input from position trackers connected to the user. With 
regard to claims 17 and 20, which further teach detecting means for detecting an 
impairment of the ability of the user to communicate in a first communication mode 
based on an environmental or physical attribute, Filo teaches, in column 3, lines 9-15, 
the avatar's representation is based on input from position trackers connected to the 
user. Filo further teaches, in column 10, line 62 through column 11, line 18, detecting a 
user receiving a phone call or looking at a page, where without requiring the user to 
remove themselves from the Virtual Environment they are able to use the phone or view 
a page in private. Taking a phone call for example automatically disengages the audio 
link to the VCP and displays a phone icon next to the avatar, while viewing a page, a 
users avatar can be seen looking a his wrist watch (reading the page) (further see 
column 3, lines 15-21). With regard to claims 17 and 20, which further teach means for 
automatically changing, without user input, the user's mode of communication to a 
second communication mode, so as to accommodate the detected impairment, Filo 
further teaches, in column 10, line 62 through column 11, line 18, Taking a phone call 
for example automatically disengages the audio link to the VCP and displays a phone 
icon next to the avatar, while viewing a page, a users avatar can be seen looking a his 
wrist watch (reading the page) (further see column 3, lines 15-21). Here the first mode 
is the user operating in the VCP with standard communication between themselves and 
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all other participants, and the second mode has the user being still in the virtual 
environment by shown as busy, being occupied by a private conversation via a phone 
or pager. With regard to claims 17 and 20, which further teach means to configure or 
modify the representation of the user to the at least one other party in dependence on 
the detected environmental or physical attribute, Filo teaches, in column 3, line 1 
through column 4, line 26, several users, each being represented by an avatar in the 
virtual environment, affecting changes in the other users display via physical movement. 

1 0. With regard to claim 1 8, which teaches the representation of the user comprising 
a moving visual image, Filo teaches, in column 9, lines 35-39, the user being 
represented by an avatar the moves through a series of articulated joints in response to 
changes in motion detected by the user's hand trackers. 

1 1 . With regard to claim 1 9, which teaches the representation of the user comprising 
an avatar, Filo teaches, in column 9, lines 35-39, the user being represented by an 
avatar the moves through a series of articulated joints in response to changes in motion 
detected by the user's hand trackers. 

✓ 

12. With regard to claim 21 , which teaches the output means comprises a first output 
mode and a second output mode, and the representation of the at least one other party 
is modified by switching the output means form the first output modes to the second 
output mode, Filo teaches, in column 13, lines 5-31, and in column 3, line 1 through 
column 4, line 26, the user being in one of two output modes, a seated user (being 
represented by seated avatar) and a standing presenter (whose movements jesters are 
recognized for output to the others in the virtual environment). 
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13. With regard to claim 22, which teaches the first output mode comprising a video 
output, and the second output mode comprises an audio output, Filo further teaches, in 
column 13, lines 43-55 and column 10, lines 51-54, an output mode, where a non- 
immersed user is able to provide audio and/or video output to the session. 

14. With regard to claim 23, further teaching means to provide the user with 
information alerts related to an automatically detected environmental or physical 
condition, Filo teaches, column 13, lines 43-55 and column 10, lines 51-54, an output 
mode, where a non-immersed user is able to provide live audio and/or video to the 
session. Filo further teaches, in column 10, line 51 through column 11, line 11, the 
system detecting a person from outside the environment attempting to connect with a 
user in a private conversation, to accommodate the user enters into a private phone call 
mode which disables the audio links to the VCP, and displays a phone icon next to the 
avatar to the other avatars. 

15. With regard to claim 25, further teaching the environmental or physical attribute is 
a change in an acceleration or a force associated with a user, Filo teaches, in column 9, 
lines 35-39, the user being represented by an avatar the moves through a series of 
articulated joints in response to changes in motion detected by the user's hand trackers, 
where the movement from a stationary state is an acceleration of force. 

16. With regard to claim 26, further teaching the environmental or physical attribute is 
a location, Filo teaches, in column 8, line 58 through column 9, line 5 and lines 40-60, 
avatars being moved into virtual rooms for meetings. 
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17. With regard to claim 27, further teaching the environmental or physical attribute is 
an attribute is a direction of changing user location, Filo teaches, in column 3, lines 15- 
19, correlating changes in hand an head movement, where this correlation need 
coincide with the direction. 

18. With regard to claim 28, further teaching the environmental or physical attribute is 
a change in velocity, Filo teaches, in column 9, lines 35-39, the user being represented 
by an avatar the moves through a series of articulated joints in response to changes in 
motion detected by the user's hand trackers, where the movement is a velocity. 

19. With regard to claim 29, further teaching the environmental or physical attribute is 
a movement of a user, Filo teaches, in column 9, lines 35-39, the user being 
represented by an avatar the moves through a series of articulated joints in response to 
changes in motion detected by the user's hand trackers, where the movement is a 
velocity; and in column 8, line 58 through column 9, line 5 and lines 40-60, avatars 
being moved into virtual rooms for meetings. 

20. With regard to claim 31 , further teaching the environmental or physical attribute is 
privacy level of the user, Filo teaches, in column 9, lines 14-22, the user being able to 
view number of people in the virtual room, showing him how private the conversation 
will be. 

21 . With regard to claim 32, further teaching processing means for processing data 
indicative of the environmental or physical attribute, Filo teaches, in column 7, lines 9- 
15, a processing of the graphics in correspondence with manipulation of the avatars. 
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22. With regard to claim 33, which teaches the processing means utilizing a 
classification or analysis algorithm, Filo teaches, in column 3, lines 4-1 9, analyzing hand 
and head movements and mapping them to the virtual avatar on the screen. 

23. With regard to claim 35, which teaches a system comprising: a mobile device for 
communication between a user of the mobile device and at least one other party, Filo 
teaches, in column 7, lines 9-15, and lines 25-36, a wearable personal computer that 
transmits changes in the users voice and positional data via a network to the personal 
computers of all other users in attendance of a virtual environment. With regard to the 
claim, which further teaches a mobile user interface for connection with the mobile 
device including input means for providing the at least one other party with a 
representation of the user, Filo teaches, in column 3, lines 1-23, users being 
represented by avatars on the display device of users computers, the avatar's 
representation is based on input from position trackers connected to the user. With 
regard to the claim, which further teaches output means for providing the user with a 
representation of the at least one other party, Filo teaches, in column 3, lines 4-9, a 
display device showing a representation of avatars (users) in the environment. With 
regard to the claim, which further teaches detecting means for detecting an impairment 
of the ability of the user to communicate in a first communication mode based on an 
environmental or physical attribute, Filo teaches, in column 3, lines 9-15, the avatar's 
representation is based on input from position trackers connected to the user. Filo 
further teaches, in column 10^ line 62 through column 11, line 18, detecting a user 
receiving a phone call or looking at a page, where without requiring the user to remove 
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themselves from the Virtual Environment they are able to use the phone or view a page 
in private. Taking a phone call for example automatically disengages the audio link to 
the VCP and displays a phone icon next to the avatar, while viewing a page, a users 
avatar can be seen looking a his wrist watch (reading the page) (further see column 3, 
lines 1 5-21). With regard to the claim, which further teaches means for automatically 
changing, without user input, the user's mode of communication to a second 
communication mode, so as to accommodate the detected impairment, Filo further 
teaches, in column 10, line 62 through column 11, line 18, Taking a phone call for 
example automatically disengages the audio link to the VCP and displays a phone icon 
next to the avatar, while viewing a page, a users avatar can be seen looking a his wrist 
watch (reading the page) (further see column 3, lines 15-21). Here the first mode is the 
user operating in the VCP with standard communication between themselves and all 
other participants, and the second mode has the user being still in the virtual 
environment by shown as busy, being occupied by a private conversation via a phone 
or pager. With regard to the claim, which further teaches means for configuring or 
modifying the representation of the at least one other party to the user in dependence 
on the detected environmental or physical attribute, Filo teaches, in column 3, lines 1- 
23, updating the representation of the avatar, displayed to other users, depending on 
the detected visual (head and hand movement) changes. Filo further teaches, in 
column 1 1 , lines 12-15, other parties being represented as a page message display on 
a wristwatch. With regard to the claim, which further teaches means to configure or 
modify the representation of the user to the at least one other party in dependence on 
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the detected environmental or physical attribute, Filo teaches, in column 3, line 1 
through column 4, line 26, several users, each being represented by an avatar in the 
virtual environment, affecting changes in the other users display via physical movement. 
Filo teaches, in column 10, line 68 through column 11, line 18, while using a phone, 
displaying a phone icon next to the avatar, while viewing a page, a users avatar can be 
seen looking a his wrist watch (reading the page) (further see column 3, lines 15-21). 

24. With regard to claim 36, further teaching a store for storing predetermined 
information corresponding to the detected environmental or physical attribute, Filo 
teaches, in column 3, lines 8-25, a database for storing computer information and 
graphics supporting the appearance of the avatars that populated the virtual work 
environment. 

25. With regard to claims 37, 42, 44, and 46, which teach communication between 
the user of the mobile device and more than one other party, Filo teaches, in column 7, 
lines 9-15, and lines 25-36, a wearable personal computer that transmits changes in the 
users voice and positional data via a network to the personal computers of all other 
users in attendance of a virtual environment. 

26. With regard to claim 39, which teaches which teaches a system comprising: a 
mobile device for communication between a user of the mobile device and at least one 
other party, Filo teaches, in column 7, lines 9-15, and lines 25-36, a wearable personal 
computer that transmits changes in the users voice and positional data via a network to 
the personal computers of all other users in attendance of a virtual environment. With 
regard to claim 39, further teaching a mobile user interface for connection with the 
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mobile device including input means for providing the at least one other party with a 
representation of the user, Filo teaches, in column 3, lines 1-23, users being 
represented by avatars on the display device of users computers, the avatar's 
representation is based on input from position trackers connected to the user. With 
regard to claim 39, further teaching output means for providing the user with a 
representation of the at least one other party, Filo teaches, in column 3, lines 4-9, a 
display device showing a representation of avatars (users) in the environment. With 
regard to claim 39, further teaching detecting means for detecting an impairment of the 
ability of the user to communicate in a first communication mode based on an 
environmental or physical attribute, Filo teaches, in column 3, lines 9-15, the avatar's 
representation is based on input from position trackers connected to the user. Filo 
further teaches, in column 10, line 62 through column 11, line 18, detecting a user 
receiving a phone call or looking at a page, where without requiring the user to remove 
themselves from the Virtual Environment they are able to use the phone or view a page 
in private. Taking a phone call for example automatically disengages the audio link to 
the VCP and displays a phone icon next to the avatar, while viewing a page, a users 
avatar can be seen looking a his wrist watch (reading the page) (further see column 3, 
lines 15-21). With regard to claim 39, further teaching processing means for processing 
data indicating the environmental or physical attribute, Filo teaches, in column 7, lines 
9-15, a processing of the graphics in correspondence with manipulation of the avatars. 
With regard to claim 39, further teaching means for automatically changing, without user 
input, the user's mode of communication to a second communication mode, so as to 
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accommodate the detected impairment, Filo further teaches, in column 10, line 62 
through column 11, line 18, Taking a phone call for example automatically disengages 
the audio link to the VCP and displays a phone icon next to the avatar, while viewing a 
page, a users avatar can be seen looking a his wrist watch (reading the page) (further 
see column 3, lines 15-21). Here the first mode is the user operating in the VCP with 
standard communication between themselves and all other participants, and the second 
mode has the user being still in the virtual environment by shown as busy, being 
occupied by a private conversation via a phone or pager. With regard to claim 39, 
further teaching means for configuring or modifying the representation of the at least 
one other party to the user in dependence on the detected environmental or physical 
attribute, Filo teaches, in column 3, lines 1-23, updating the representation of the avatar, 
displayed to other users, depending on the detected visual (head and hand movement) 
changes. Filo further teaches, in column 1 1 , lines 12-15, other parties being 
represented as a page message display on a wristwatch. With regard to claim 39, 
further teaching means to configure or modify the representation of the user to the at 
least one other party in dependence on the detected environmental or physical attribute, 
Filo teaches, in column 3, line 1 through column 4, line 26, several users, each being 
represented by an avatar in the virtual environment, affecting changes in the other users 
display via physical movement. Filo teaches, in column 10, line 68 through column 11, 
line 18, while using a phone, displaying a phone icon next to the avatar, while viewing a 
page, a users avatar can be seen looking a his wrist watch (reading the page) (further 
see column 3, lines 15-21). With regard to claim 39, further teaching a computer for 
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connection with the mobile device and/or the mobile user interface including means for 
defining a virtual meeting space for communications between the user and the at least 
one other party, Filo teaches, in column 8, lines 45-51, the virtual environment including 
maps, documents, presentation materials, etc., and further teaches, in column 8, line 58 
through column 9, line 5, avatars being moved into virtual rooms for meetings. With 
regard to claim 39, further teaching means for controlling the representation of the user 
and the at least one other party to each other in dependence on the detected 
environmental or physical attribute, Filo teaches, in column 9, lines 14-39, avatars being 
presented to other users being manipulated by hand movements being detected 
through hand trackers. 

27. With regard to claim 40, which teaches which teaches a system comprising: a 
mobile device for communication between a user of the mobile device and at least one 
other party, Filo teaches, in column 7, lines 9-15, and lines 25-36, a wearable personal 
computer that transmits changes in the users voice and positional data via a network to 
the personal computers of all other users in attendance of a virtual environment. With 
regard to claim 40, further teaching a computer for connection with the mobile device 
and/or the mobile user interface including means for providing the at least one other 
party with a representation of the user, Filo teaches, in column 3, lines 1-23, users 
being represented by avatars on the display device of users computers, the avatar's 
representation is based on input from position trackers connected to the user. With 
regard to claim 40, further teaching output means for providing the user with a 
representation of the at least one other party, Filo teaches, in column 3, lines 4-9, a 
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display device showing a representation of avatars (users) in the environment. With 
regard to claim 40, further teaching detecting means for detecting an impairment of the 
ability of the user to communicate in a first communication mode based on an 
environmental or physical attribute, Filo teaches, in column 3, lines 9-15, the avatar's 
representation is based on input from position trackers connected to the user. Filo 
further teaches, in column 10, line 62 through column 11, line 18, detecting a user 
receiving a phone call or looking at a page, where without requiring the user to remove 
themselves from the Virtual Environment they are able to use the phone or view a page 
in private. Taking a phone call for example automatically disengages the audio link to 
the VCP and displays a phone icon next to the avatar, while viewing a page, a users 
avatar can be seen looking a his wrist watch (reading the page) (further see column 3, 
lines 15-21). With regard to claim 40, further teaching processing means for processing 
data indicating the environmental or physical attribute, Filo teaches, in column 7, lines 
9-15, a processing of the graphics in correspondence with manipulation of the avatars. 
With regard to claim 40, further teaching means for automatically changing, without user 
input, the user's mode of communication to a second communication mode, so as to 
accommodate the detected impairment, Filo further teaches, in column 10, line 62 
through column 11, line 18, Taking a phone call for example automatically disengages 
the audio link to the VCP and displays a phone icon next to the avatar, while viewing a 
page, a users avatar can be seen looking a his wrist watch (reading the page) (further 
see column 3, lines 15-21). Here the first mode is the user operating in the VCP with 
standard communication between themselves and all other participants, and the second 
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mode has the user being still in the virtual environment by shown as busy, being 
occupied by a private conversation via a phone or pager. With regard to claim 40, 
further teaching means for configuring or modifying the representation of the at least 
one other party to the user in dependence on the detected environmental or physical 
attribute, Filo teaches, in column 3, lines 1-23, updating the representation of the avatar, 
displayed to other users, depending on the detected visual (head and hand movement) 
changes. Filo further teaches, in column 1 1 , lines 12-15, other parties being 
represented as a page message display on a wristwatch. With regard to claim 40, 
further teaching means to configure or modify the representation of the user to the at 
least one other party in dependence on the detected environmental or physical attribute, 
Filo teaches, in column 3, line 1 through column 4, line 26, several users, each being 
represented by an avatar in the virtual environment, affecting changes in the other users 
display via physical movement. Filo teaches, in column 10, line 68 through column 11, 
line 18, while using a phone, displaying a phone icon next to the avatar, while viewing a 
page, a users avatar can be seen looking a his wrist watch (reading the page) (further 
see column 3, lines 15-21). 

28. With regard to claims 43 and 45, which teach a system comprising: a mobile 
device for communication between a user of the mobile device and at least one other 
party, Filo teaches, in column 7, lines 9-15, and lines 25-36, a wearable personal 
computer that transmits changes in the users voice and positional data via a network to 
the personal computers of all other users in attendance of a virtual environment. With 
regard to claims 43 and 45, which further teach a mobile user interface for connection 
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with the mobile device including input means for providing the at least one other party 
with a representation of the user, Filo teaches, in column 3, lines 1-23, users being • 
represented by avatars on the display device of users computers, the avatar's 
representation is based on input from position trackers connected to the user. With 
regard to claims 43 and 45, which further teach output means for providing the user with 
a representation of the at least one other party, Filo teaches, in column 3, lines 4-9, a 
display device showing a representation of avatars (users) in the environment. With 
regard to claims 43 and 45, which further teach detecting means for detecting an 
impairment of the ability of the user to communicate in a first communication mode 
based on an environmental or physical attribute, Filo teaches, in column 3, lines 9-15, 
the avatar's representation is based on input from position trackers connected to the 
user. Filo further teaches, in column 10, line 62 through column 11, line 18, detecting a 
user receiving a phone call or looking at a page, where without requiring the user to 
remove themselves from the Virtual Environment they are able to use the phone or view 
a page in private. Taking a phone call for example automatically disengages the audio 
link to the VCP and displays a phone icon next to the avatar, while viewing a page, a 
users avatar can be seen looking a his wrist watch (reading the page) (further see 
column 3, lines 15-21). With regard to claims 43 and 45, which further teach means for 
automatically changing, without user input, the user's mode of communication to a 
second communication mode, so as to accommodate the detected impairment, Filo 
further teaches, in column 10, line 62 through column 11, line 18, Taking a phone call 
for example automatically disengages the audio link to the VCP and displays a phone 
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icon next to the avatar, while viewing a page, a users avatar can be seen looking a his 
wrist watch (reading the page) (further see column 3, lines 15-21). Here the first mode 
is the user operating in the VCP with standard communication between themselves and 
all other participants, and the second mode has the user being still in the virtual 
environment by shown as busy, being occupied by a private conversation via a phone 
or pager. With regard to claims 43 and 45, which further teach means for configuring or 
modifying the representation of the at least one other party to the user in dependence 
on the detected environmental or physical attribute, Filo teaches, in column 3, lines 1- 
23, updating the representation of the avatar, displayed to other users, depending on 
the detected visual (head and hand movement) changes. Filo further teaches, in 
column 11, lines 12-15, other parties being represented as a page message display on 
a wristwatch. With regard to claims 43 and 45, which further teach means to configure 
or modify the representation of the user to the at least one other party in dependence on 
the detected environmental or physical attribute, Filo teaches, in column 3, line 1 
through column 4, line 26, several users, each being represented by an avatar in the 
virtual environment, affecting changes in the other users display via physical movement. 
Filo teaches, in column 10, line 68 through column 11, line 18, while using a phone, 
displaying a phone icon next to the avatar, while viewing a page, a users avatar can be 
seen looking a his wrist watch (reading the page) (further see column 3, lines 15-21). 
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Claim Rejections - 35 USC § 103 

29. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

30. Claims 24, 30, and 34 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Filo et al., patent #6,215,498, hereinafter Filo and Nitta, patent 
#5,347,306. 

31. With regard to claim 24, Filo teaches, in column 3, line 1 through column 4, line 
26, Several users, each being represented by an avatar in the virtual environment, 
affecting changes in the other users display via physical movement, but doesn't 
specifically teach the environmental or physical attribute is an ambient sound level. Nitta 
teaches, in column 3, lines 1-15, a virtual meeting place with participants being 
represented as avatars, similar to that of Filo, but further teaches, in column 3, lines 25- 
39, column 7, lines 20-26, and column 6, lines 41-50, sound being steered toward the 
individual determined to be speaking, where ambient noise is picked up and determined 
to be relevant or extraneous. It would have been obvious to one of ordinary skill in the 
art, having the teachings of Filo and Nitta before him at the time the invention was made 
to modify virtual presentation system of Filo to include ambient noise and focusing the 
audio to minimize the ambient sound volume. One would have been motivated to make 
such a combination because ambient noise is a part of every conversation and need be 
recognized as such. 
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32. With regard to claim 30, Filo teaches, in column 3, line 1 through column 4, line 
26, Several users, each being represented by an avatar in the virtual environment, 
affecting changes in the other users display via physical movement, but doesn't 
specifically teach the environmental or physical attribute is a posture of the user. Nitta 
teaches, in column 3, lines 1-15, a virtual meeting place with participants being 
represented as avatars, similar to that of Filo, but further teaches, in column 3, lines 12- 
16, the users posture being a physical attribute. It would have been obvious to one of 
ordinary skill in the art, having the teachings of Filo and Nitta before him at the time the 
invention was made to modify virtual presentation system of Filo to include posture 
changes. One would have been motivated to make such a combination because this 
provides a user with a better representation of the other users in the system. 

33. With regard to claim 34, Filo teaches, in column 3, line 1 through column 4, line 
26, Several users, each being represented by an avatar in the virtual environment, 
affecting changes in the other users display via physical movement, but doesn't 
specifically teach the processing means utilizing a Hidden Markov Model. Nitta 
teaches, in column 3, lines 1-15, a virtual meeting place with participants being 
represented as avatars, similar to that of Filo, but further teaches, in column 3, lines 35- 
40 and column 6, lines 41-50, the processing by knowing the a user exists without 
actually knowing the users exact position, but rather estimating a position. This process 
obviously could be implemented by or is actually being implemented with a Hidden 
Markov Model. It would have been obvious to one of ordinary skill in the art, having the 
teachings of Filo and Nitta before him at the time the invention was made to modify the 
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virtual meeting system of Filo to include this hidden state system of Nitta. One would 
have been motivated to make such a combination because this allows physical changes 
without the certainty of user definition. 

34. Claims 38 and 41 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Filo et al., patent #6,215,498, hereinafter Filo and Sun et al., patent #6,501,740, 
hereinafter Sun. 

35. With regard to claims 38 and 41, Filo teaches, in column 3, line 1 through column 
4, line 26, Several users, each being represented by an avatar in the virtual 
environment, affecting changes in the other users display via physical movement and 
Filo further teaches', in column 10, line 51 through column 11, line 1 1, the system 
detecting a person from outside the environment attempting to connect with a user in a 
private conversation, to accommodate the user enters into a private phone call mode 
which disables the audio links to the VCP, and displays a phone icon next to the avatar 
to the other avatars, but doesn't specifically teach detecting a level of service in the 
connection between the computers, and modifying the representation of the user to the 
at least one other party in dependent on the detected quality of service. Sun teaches a 
teleconference system where conferees can be presented with virtual reality animations 
(see column 5, lines 50-63), but further teaches the system recognizing the type of 
connection of each conferee connected to the teleconference, and adapting the signal 
sent to a conferee based on the connection, for example only the audio portion of a 
signal from a video conference is sent to a conferee connected by a conventional 
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telephone (see column 5, line 50 through column 6, line 34). It would have been 
obvious to one of ordinary skill in the art, having the teachings of Filo to include the 
exclusion of the video portion to a participant that doesn't have video capabilities and to 
display the limited connectivity user with an icon as was done with the phone icon of 
Filo. One would have been motivated to make such a combination because a 
participant without video capabilities would be unable to view the presenter anyway. 

Response to Arguments 

36. The arguments filed on 5-14-2007 have been fully considered but they are not 
persuasive. Reasons set forth below. 

37. The Applicant further argues that the prior art of record doesn't teach "detecting 
means for detecting an impairment of the ability of the user to communicate in a first 
communication mode based on an environmental or physical attribute", arguing that 
"disengagement" from the virtual environment is not the result of a detected 
environmental or physical attribute which impairs the user's communication ability. 

38. In response the Examiner respectfully submits that when a user takes a phone 
call or page they are still "immersed" in the virtual environment (see column 10, lines 
63-65), but they are in a mode where some forms of communication are temporarily 
suspended, where without requiring the user to remove themselves from the Virtual 
Environment they are able to use the phone or view a page in private. Taking a phone 
call for example automatically disengages the audio link to the VCP and displays a 
phone icon next to the avatar, while viewing a page, a users avatar can be seen looking 
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a his wrist watch (reading the page) (further see column 3, lines 1 5-21). Here the first 
mode is the user operating in the VCP with standard communication between 
themselves and all other participants, and the second mode has the user being still in 
the virtual environment by shown as busy, being occupied by a private conversation via 
a phone or pager. 

39. The Applicant further argues that the detecting causes "a corresponding change 
in communication modes only when there is a detected impairment related to an 
environmental or physical attribute. 

40. In response the Examiner respectfully submits that Filo further teaches, in 
column 10, line 62 through column 11, line 18, Taking a phone call for example 
automatically disengages the audio link to the VCP (mode change) and displays a 
phone icon next to the avatar, while viewing a page, a users avatar can be seen looking 
a his wrist watch (reading the page) (further see column 3, lines 15-21). Here the first 
mode is the user operating in the VCP with standard communication between 
themselves and all other participants, and the second mode has the user being still in 
the virtual environment by shown as busy, being occupied by a private conversation via 
a phone or pager. 

Conclusion 

41 . Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Dennis G. Bonshock whose telephone number is (571) 
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272-4047. The examiner can normally be reached on Monday - Friday, 6:30 a.m. - 4:00 
p.m. 

42. If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Cabeca can be reached on (571) 272-4048. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

43. Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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